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Abstract 

We study the following Brezis-Nirenberg problem of Kirchlioff type 

j —{a + bj \Vu\^dx)Au = X\u\'^~^u + S\u\^u, in fl, 

M = 0, on dUt, 

where C is a bounded domain with the smooth boundary dUl, 2 < q < 4 and a, b, A, 5 
are positive parameters. We obtain some new existence and nonexistence results, depending 
on the values of the above parameters, which improves some known results. The asymptotical 
behaviors of the solutions are also considered in this paper. 

Keywords: Kirchhoff type equation; nonlocal problem; Brezis-Nirenberg problem; perturbation 
method. 
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1 Introduction 

In this paper, we consider the following Kirchhoff type problem involving critical nonlinearity 

— (a-1-6 [ \Vu\^dx)Au = X\u\‘^~^u + S\u\^u, in C, 

< Jn ( 1 . 1 ) 

u = 0, on dCl, 

where C C is a bounded domain with the smooth boundary dfit, 2 < q < 4, a, b, X, S are 
positive parameters. 

Eq. (11.111 is related to the stationary of the Kirchhoff type quasilinear hyperbolic equation 

utt-(a + b J \Vu\'^dy^Au = f{x,u), in C, (1.2) 
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that was first proposed by Kirchhoff in m describing the transversal oscillations of a stretched 
string. For more details on the physical and mathematical background of Eq. (O, we refer the 
readers to the papers H HD m [21] and the references therein. Besides the physical motivation, 
such problems are often referred to as being nonlocal because of the presence of the term \ Vu\^dx 
which implies that the equation in (1.1) is no longer a pointwise identity. This phenomenon leads 
to some mathematical difficulties, which makes the study of such a class of problems particularly 
interesting. Equations like (HH) has been studied extensively by using variational methods recently, 
see [a 131 El [Ill |T6lll2l[Tll|23l |2ll|25l|26l|22l|3l IMI [Sa [36] and the references therein. 

In the study of Eq. (HI), our main concern is focused on the nonlinearities with critical 
growth starting from the pioneering paper |5] by Brezis and Nirenberg, in which dH) is studied 
in the case oi a = 5 = 1 and 6 = 0. Many mathematicians have paid great attention to this 
type of critical problems for their stimulating and challenging difficulties coming from the lack of 
compactness of the Sobolev imbedding Hq{Q) =>• L^*(0), see e.g. |S1131 (131 (HI IHl Ell EH ED 
and the references therein for the existence and multiplicity results. Recently the Brezis-Nirenberg 
problem of Kirchhoff type is investigated in EmUEIlES] and the references therein. 

In order to describe better our results, we distinguish two cases of g = 2 and 2 < q < 4 
according to the range of q. 

1.1 The case oi q = 2 and A > aAi, i.e. the indefinite case of Kirchhoff 
type Brezis-Nirenberg problem 

In this case, Eq. dni) becomes the following Brezis-Nirenberg problem involving Kirchhoff type 
nonlocal term 

— {a + b / \'\/u\'^dx)Au = Xu + S\u\‘^u, in fl, 

Jn (1.3) 

u = 0, on dfl, 

which has been proved to have a solution for A G (0, oAi) if and only if 0 < bS^ < 6 by Naimen in 
pS] recently, where Ai is the first eigenvalue of — A on SI and S is the best Sobolev constant defined 
in ()2.2D . Then some natural questions are arisen: what will happen if A > oAi? What about the 
asymptotical behaviors of the solutions depending on the parameters? The first aim of this paper 
is to try to answer these questions. Note that, compared with the case of A < oAi, the case of 
A > aAi is more sophisticated because the operator —aA — A is indefinite. In order to deal with 
this case, besides the typical difficulty caused by the lack of compactness of the Sobolev embedding 
HQ{n) ^ L'^iyi), we will face the following three difficulties: the first is to prove the boundedness 
of the Palais-Smale sequence (the {PS) sequence in short); the second is the interaction between 
the Kirchhoff type perturbation and the critical nonlinearity \u\'^dx, in particular, they 

have the same exponent; the third is that the weak limit of the bounded {PS) sequence cannot be 
seen as the weak solution of Eq. dH directly. 

According to the relationship between bS^ and 6, we will consider the following two cases: 
0 < i5 < bS^ and 0 < bS^ < 6. Eor the first case, in order to study the asymptotical behaviors of 
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the solutions, we give some existence results of solutions for the following eigenvalue problem 





\Vu\'^dx)Au = Am, 


u = 0, 


in n, 
on dH,. 


(1.4) 


Theorem 1.1 Suppose that a > 0, b > 0 and A > 0. 

(I) If X G (0,aAi] then Eq. (11.41) has no nontrivial solution. 

(II) If X G (aAi,aA 2 ] then Eq. p.4D has a unique positive ground state solution u = 

(III) If X G (aAfe,aAfc+i] with k > 2 then Eq. (11.41) has a unique positive ground state solution 
u = moreover, Eq. ca has sign-changing solutions Uj = for all 

ipj G M{Xj) satisfying 

ifj = ^ Cij(pij with ^ cfj = 1, j = 2,3, • • • fc, 

2—1 2—1 

where M{Xj), (pij and ij will be given in Section\^ 

Remark 1.1 As far as we know, there is no result on the eigenvalue problem (11.41) in literatures. 
Comparing to the well-known results in the case 6 = 0, we see that Eq. da also has infinitely 
many sign-changing solutions provided A G {aXk,aXk-\-i] with k > 2. Eq. (11.41) can be seen as the 
limited problem of (11.31) as d ^ O"*", which will help us to study the asymptotical behaviors of the 
solutions of (na- 

Now we give some existence and nonexistence results of solutions for Eq. dia in the case of 

0 < (5 < 552. 

Theorem 1.2 Suppose that a>0, & >0, A>0 and d > 0 with 0 < ^ < bS^. 

(1) If X G (0,aAi] then Eq. (11.31) has no nontrivial solution. 

(2) If X > aXi and d < bS^ then Eq. (11.31) has one positive ground state solution. 

(3) Assume that X G (oAfc, oAfe+i] with k > 1 and {(5„} is a sequence of positive numbers satisfying 
Sn ^ 0 as n ^ 00. Let Un be the positive ground state solution corresponding to Sn, then 
there exists uq G Ho (ft) \ {0} such that Un —t uq in i?o(fl) as n ^ 00, up to a subsequence. 
Moreover, 

X — aXi 

= V 

is a positive ground state solution of the problem of (na- 

Remark 1.2 The conclusions of (3) of Theorem 11.21 gives a description of asymptotical behavior 
of the positive ground state solution of (11.31) as d —)• O’*', however, an interesting problem is that, 
besides the positive ground state solution, is there any solution of m converging to a sign¬ 
changing solution of ca as (5 —> O’*' if d < bS^l 
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For the case of 0 < bS^ < S, we have the following results. 


Theorem 1.3 Suppose that a>0,b>0, X>0 and 5 > 0 with S > bS^. 


(i) If 


uAi ^ A ^ 


<- 1 — 

- S-bS^ 


aAi(5 


(1.5) 


then Eq. dOl) has at least one pair of sign-changing solutions under one of the following 
conditions: 


(1) i5 > 0, 6 > 0 is sufficiently small; 

(2) b > 0, S > 0 is sufficiently large. 


(ii) For a, S > 0 and let {6„} and {An} be two sequences of positive numbers satisfying bn ^ 0 and 


A„ aXi as n ^ oo. Assume that Un is the solution corresponding to bn and An obtained 
above, then there exists uq £ Hoi^) \ {0} such that Un —>■ wo Hq{Q.) as n ^ oo, up to a 
subsequence, and uq is a sign-changing solution of the following equation: 



in fl, 
on dfl. 


( 1 . 6 ) 


Remark 1.3 (i) From our results, we see that when A > aAi, the cases of 6 = 0 and & > 0 are 

quite different. 

(ii) Theorems o and 11.31 complement and generalize the results of [551 Theorem 1.1] and [51 

Theorem 0.1]. The assumption can be removed if A = oAi. Moreover, the asymptotical 
behaviors of the solutions are respectively given in Theorem ll.2l as ^ 0 and in Theorem ll.3l 

as 6 0. 

(iii) According to Eq. (|1.6I1 has multiple nontrivial solutions if we take the place of Ai 

by A, moreover the existence of ground state solutions of Eq. (HU also obtained in [301HB, 
however, both of the existence of ground state solutions and the multiplicity of nontrivial 
solutions of (HU are still unknown for A > aAi and 6 > bS^. 

1.2 The case of 2 < g < 4 and Naimen’s open qnestion. 

The case of 2 < g < 4 is more thorny and tough because the boundedness of the (PS) sequences 
is hard to prove. To overcome this difficulty, by using the well-known monotonicity trick due to 
Struwe (see also HUES]), Naimen [25] obtained the following theorem: 

Theorem A. ([251 Theorem 1.6]) Suppose that 2 < q < 4. Let b,S > 0 satisfy bS^ < 6 < 2bS^ and 
let C be strictly star shaped. Furthermore, assume that one of the following conditions (Cl), 
(C2) and (C3) holds: 

(Cl) a > 0, A > 0 is small enough, 

(C2) A > 0, a > 0 is large enough, 

(C3) a > 0, A > 0 and 6/h > is sufficiently close to , 
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then Eq. (ED has a nontrivial solution. 

Naimen’s open question. On Page 1171], Naimen asked whether conditions that fx < 2bS'^, 
O C is strictly star-sharped and (C1)-(C'3) in Theorem A are necessary to ensure the existence 
of the solutions of Eq. ED- 

Another purpose of the present paper is to try to give an answer to Naimen’s open question. In 
order to do this, inspired by [3 mm HO], we will construct a bounded (PS) sequence and show 
that the critical level of the functional is below the compactness threshold by applying a 

perturbation method, then we obtain the following result which gives a partial answer to Naimen’s 
open question. 

Theorem 1.4 Suppose that 2<g<4, a>0, 6>0, A>0 and <5 > 0 with 6 > bS^. Then there 
exists 64 > 0 such that for each b € (0, b^), Eq. (11.11) has a solution if one of the above conditions 
(Cl)-((73) is satisfied. 

It is worth observing that Theorem 11.41 is complementary to the corresponding result of [IS 
Theorem 1.1], where A > 0 is assumed to be large enough. 

Furthermore, according to Theorem ll.41 a natural questions about Eq. ED can be arisen: what 
will happen if 0 < (5 < bS^? For this question, we have the following nonexistence and multiplicity 
results. 

Theorem 1.5 Suppose that 2<q<4:, a>0,b>0, X>0 and <5 > 0 with 5 < bS^. 

(i) If S < bS^ and 



(1.7) 


then Eq. ED has no nontrivial solution; 


(ii) there exists 62 > 0 dependent of a and A such that for each b £ ( 0 , 62 ); Eq- P-IK has at least 
two nontrivial solutions provided S < bS^ and has at least one nontrivial solution provided 
5 = bS^. 


This paper is organized as follows. In Section [S we give some preliminaries. In Section [S we 
give a proof of Theorem ll.il Section Sj is devoted to prove Theorems II.21 and II.31 bv using Ekeland 
variational principle and applying an idea of (S, in order to overcome the interaction between 
the nonlocal term and the critical nonlinearity, we give some new estimates (see Lemma |4.4I) . In 
Section [5| we prove Theorems 11.41 and 11.51 by using a perturbation method introduced in |3 HD]. 

2 Preliminaries 

Throughout this paper, we will use the following common notations. 

Notations: 

• LP{n) is the usual Lebesgue space with the norm ||m||p = (Jq \uY‘dxY^^. 

1 / ^ 

• and ^^’^(R"^) are the usual Sobolev space with the associated norms HmH = (Jq \Vu\^dx) 

1/2 

and ||u||xi = (/r 4 jVupda:) respectively. 
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• Denote by 0 < Ai < A 2 < • • • < A^ < ■ ■ ■ ,j £ N the eigenvalues of (—A, i/p (D)) and by 
M{Xj) the corresponding eigenspace of Xj in 

• {‘Pij} is the orthogonal eigenfunctions corresponding to Xj spanning M{Xj) and \(pij\'^dx = 
1, i = 1,2,- ■ - ij, where ij = dimAf (Aj). 


• He is a bounded domain and denote |ff| by the Lebesgue measure of H. 

• C,Ci,C 2 , ■ ■ ■ denote the positive (possibly different) constants. 

We first note that the corresponding functional of dm I : Hq{H) —R is given by 

I{n) = ^\\ur + l\\u\\^ - ^WuWl - ^-\\u\\i V u 6 (2.1) 

Clearly, I £ and 


l'{u)v = {a + b\\u\\'^) j VuS/vdx — X j |m|'^ ^uvdx — 5 j \u\^uvdx, \/ u,v e Hq{H). 

J Q, J Q, J Q, 

Recalling that the best Sobolev constant S of I?^’^(R^) ^ L^(R^) defined as 

5 = inf /r4 \Vu\^dx 

can be achieved by the Talenti function 


( 2 . 2 ) 


(8e)i/2 


(2.3) 


Ue{x) := 

e+\x — a;o|- 

which is the positive solution of the problem in whole space 

—At/ = [/^, in R^, U{x) —>-0 as |x| —>■ 00 

for some £ > 0 and xq £ R^. As a matter of fact, when hS^ < 5, the Talenti function multiplied 
by an appropriate constant, 

is nothing but a solution of the Kirchhoff type equation in whole space 

-{a + b [ IVVCHAW = (5W^ in R^, W(x)0, as |x| ^ 0. (2.4) 

./r4 

Moreover, we can easily check that the functional energy of 144 satisfies 

(aS^) 


^\\We\\i + j\mfj,-j[ m^dx = 

2 4 4 Jr4 


4((5 - 652) ■ 

However, it is easy to see that (1^ has no nontrivial solutions if 0 < 6 < 65^. Indeed, if not, we 


assume that W £ 22^’2(R4) \ {0} is a solution of (|2.4L then we obtain 

0 = a\\W\\l + b\\W\\i, - S [ \W\Ux > a\\W\\l + (6 - ^)||W|||, > a\\W\\l > 0, 

Jr* 


6 

52 

this is a contradiction. 

The following result can be obtained using the mathematical induction. 


(2.5) 
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Lemma 2.1 Let Xk, yk S (A: = 1, 2, • • • n) he positive constants, then it holds 


1 Xi (Xk 7 1 D 1 

— < max<^ —,A; = 

Vi ^ Vk ■' 

Next, we list a global compactness result which gives the description of {PS)c sequence (cf. 

[25]). 


Proposition 2.1 Let c G R and {u„} C L[q{LI) C be a bounded {PS)c for I, that is, 

I{un) —>■ c, I'{un) —> 0 m P[~^{Vl) and {un} is bounded. Then {u„} has a subsequence which 
strongly converges in HQ{fl), or otherwise, there exist a function uq G Hq{LI) which is a weak 
convergence of {un}, a number fc G N and further, for every i G {1,2, • • • k}, a sequence of value 
{Rh}nGti C K“'", points {xi}„gN C LI and a function Vi G satisfying 

k 

- |a + + X! = Aug + (5 mo, in LI, (2.6) 

i=i 

k 

- |a + fo(^||uo|p +^||uj 111,^1 Aui =(5uf, m (2.7) 

t=i 

such that up to subsequences, there hold Rl^dist{x'!^, dQ) oo, 


k 

Un-Uo-'^RlVi{Rl{- 
2 = 1 



0 ( 1 ), 


and 


\\Unf = l|uo||^+XI 11^*11® + o(l) 
2=1 

k 

/(u„) = 7(uo)+X?‘"(^0 + o(l) 
2 = 1 


where o(l) ^0 as n ^ oo and we define 


Uuo) ■= (I + ^(l|wo| 


k 

-El 

t=l 






\uo\‘^dx - - 


\uo\^dx, 


( 2 . 8 ) 


k 

7-(uo):={^ + E||uo||^ + XIKII®)}|^*II®-7 [ (2-9) 

i=i 

Finally, we recall a critical point theorem (cf. (5] Theorem 2.4]) which is a variant of some 
results contained in [1]. 

Theorem 2.1 Let H be a real Hilbert space and I G (7^(77, R) he a functional satisfying the 
following assumptions: 


(oi) 7(u) = I{—u), 7(0) = 0 for any u G 77; 

( 02 ) there exists /3 > 0 such that I satisfies (PS) condition in (0,/3); 

( 03 ) there exist two closed subspace V, W C H and positive constants p, rj such that 
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(o 3 i) I{u) < P for any u £ W; 

( 032 ) ^(w) > 77 for any u € V with ||m|| = p; 

(033) codimV < 00 . 

Then there exist at least m pair of critical points with the corresponding critical values in [ 77 , /3) 
and 

m = dimiy fl W) — codimlV © W). 


3 Proof of Theorem 11.11 

Let the corresponding functional J : Hq{TI) —> K. of (11.41) be defined by 

J{u) = |||u|p + ^Wuf - ^||u||2, u G yy). (3.1) 

Clearly, the J G (^^(iLo (O), R) and 

J'{u)v = {a + bWuW'^) / VuVvdx — X / uvdx, u, v G Lfg(n). 

Jq Jn 

Therefore critical points of J are the weak solutions of dLl. 


Proof of of Theorem 11.11 

(I): Suppose on the contrary that Eq. (jl.4l) has a nontrivial solution u G Hq^) \ {0} for A G 
(0, aAi], then we have 

0 = allwf + 6||7rf - A||M||i > (a - + b\\u\\^ > 0, 

this is impossible. 

Before giving the proofs of (II) and (III), we shall prove the following claim; 

Claim: If A G {aXk, aAfc+i] with fc > 1 then is a nontrivial solution of (11.41) if and only if u has 
the form of 

(3.2) 

where tpj G M{Xj) satislying 

i’j = X! and ^ Cij =1, j = 1, 2, • • • fc. 

i—1 i—1 


Indeed, is a nontrivial 


solution of (11.41) if and only if is a solution of the eigenvalue problem 


Thus we must get 


—Am = 


a - 

M = 0, 


6||m|| 


in 12, 
on 912. 


A 

a + 6||m|P 


= Xj and M = tjifj, 
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for some tj > 0, ipj G M{Xj) with ||V^j||| = 1, i.e., A = aXj + bXjt'^\\ipj\\'^ < aXk+i, which implies 
that 


tj = 


IX — aAo 

~W~ 


. i = 1>2, 


SO that 


A aXj 


bXi 


tljj, 'ipj G M{Xj) with tjjj = ^ Cij(pij and ^ c^j = 1, j = 1, 2, • • • fc. 


On the other hand, if u has the form of (m, then it is easy to see that u is a solution of (HID. 
Therefore we complete the proof of this claim. 


(II): For the case of A G (aAi, aA 2 ], since ipi = ipn, it follows from the above claim that (II.41) has 
the unique positive solution 


Ul = 


IX-aXi 
bXj 


-^11- 


(III): For the case A G {aXk,aXk+i], by the above claim, we see that (jl.4|) has the solution of the 
form (13.21) . We will complete the proof of Theorem [O] by going through the following two steps. 
Step 1. J{ui) = min{ J(uj) : j = 1,2, ■ ■ ■ k}. 

Indeed, for j G {1, 2, • • • k}, we have 


J(%) = + 


b/X — aXj\^ 4 A(A —oAj) 


4 V 


6A? 


iiV'.r- 


26A? 




(A - aXjf 
46A? 


Set g[t) = —(A — atY/{Abt^), t G (0,A/a), by a direct calculation, we see that g'{t) > 0 for 
t G (0, A/a), therefore, ^(Ai) < g{X 2 ) < ■ ■ ■ < g{Xk) because Ai < A 2 < ■ • ■ < Xk, so that 
J{ui) = min{ J(?l 4 ) : j = 1, 2, • • • k}. 

Step 2. Uj is sign-changing, j = 2, 3, • • • fc. 

In fact, arguing by contradiction, without loss of generality, we may assume that Uj > 0 for 
some 2 < j < k. Recalling that v?ii > 0 in and uj G M{Xj) with 


lx a A 




lx - (iXg 


■ 1 
J 1—1 


and = I, 


then we obtain 


0 < y Ujipiidx = J ^ J Vij^iidx = 0 , 


which means that Uj = 0, this is a contradiction since ||Mj||| = (A — aXj)/{bX^) > 0. 


4 Proof of Theorems 11.21 and 11.3 

In this section, we are interested in the existence of solutions to for A > aAi. We note that 
the corresponding functional I given by (EH) with q = 2 may be indefinite. We first establish a 
lemma which gives the description of {PS)c sequence of I for the above cases. 
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Lemma 4.1 Suppose that a, X, 5 > 0, b > 0 satisfy 


aAi < A < 


aXiS 

6-bS^’ 


6|f]|A2 


< (5. 


If {un} C Hq{Q) is a {PS)c sequence of I with c € (0, 4(-^°52s^) {un} strongly converges 

HQ{n) up to a subsequence. 


in 


Proof. Let {m„} be a (PS')c sequence for I with c G (0, then 

I{un) c and l'{un) —^ 0 in as n ^ oo. (4.1) 

We claim that {it„} is bounded in Hq^XI). If not, arguing by contradiction, we may assume that 
||m„|| — )• oo as n ^ oo. Let Wn = Un/ll^tnll! we see that ||ui„|| = 1, and then there exists Wq G 
such that as n —>■ oo, 

Wn Wo in ilo(n), Wn -t Wq in (j> G (1,2*)). 


We divide into the following two cases to discussion. 
Case (i) : wq = 0. 

It follows from (14.11) and ||it„|| —oo that 


0 ( 1 ) 


I{Un) 


- Ir(Un)Un 

IWP 



a 

4 


+ o(l), 


this implies a = 0, which contradicts a > 0. 

Case {ii) : wo ^ 0, i.e., there exists Ci > 0 such that ||wra|| > ||rco|| > Ci, up to a subsequence. 
Noting that ||u„|| —?> oo as n —>■ oo, we see that 


I{un) _ a b A||m„||| (5||u„||| 
||u„||4 “2||u„||2+ 4 2||u„||4 4 ||u„||4 

= i - ^Ikn|l4 + 0(1), 


which means that 

b = ^l|w„||4 + o(l). 


(4.2) 


On the other hand, we also obtain that 

, , liun) — -gl {Un)Un a A.. ..2 

-iwp-“I-l"”"”’ 

this, together with (14.21) . yields that 

a + o ( l ) = A || u ;„||2 < A | 0 |^|| u ;„||2 < A | 0 |^ ", 

so that 

&A2|0| 

° - -2“’ 

this is a contradiction since S > 6A^|0|/a^, therefore our claim holds and {u„} is bounded. 

We will complete the proof to show that {rt„} has a subsequence which strongly converges in 
1 / 0 ( 0 ). In fact, otherwise, by Proposition 12.11 we know that there exist a function uo G i/o(0) 
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which is a weak limit of {un}, a number fc £ N and further, for every i £ {1, 2, • • • k}, a sequence 
of values {R^} C points {xl^} C fl and a function Vi £ satisfying (12.61) . (12. 7|) and 

k 

I(Un) = I{uo) + ^ T°°{Vi) + 0 ( 1 ) 


i=l 


up to subsequences, where o(l) —)► 0 as n ^ 0 and I and I°° are respectively given by 

(12^ . 


(4.3) 

and 


It follows from the Poincare inequality that 

1 


I{uo) =I{uo) - -|(a + 6A)||uo|p - A||uo|l 2 “ <^11^0114} 




(4.4) 


where A := ||mo|P + Ikillx)- By (12.91) and the Sobolev inequality we get 

Q ={a + bA)\\vi\\^ — 5 j \vi\‘^dx 


>(a + 6||uo||^ + 6|fyi|||,) |fyi|||> — 


5|h 


*111? 


52 


= ia + b\\uor)\Ml- 


S-bS^ 


so that 




52 

SHa + b\\uor) 




(4.5) 


, 5-652 

here we have used the inequality bS^ < S which can be obtained from the assumptions A > aAi, 
5 > 6|fI|A^/a^ and the following inequality 


0 < Ifyiif = A?|fyn||^ < ® 

where (fn is the positive eigenfunction of the first eigenvalue Ai of (—A,i7g(n)). 
From (12.71) and (12.91) . we see that for * £ {1, 2, • • • , k}, 

7-(u,) = 7-(u.) - i{(a + 6kl)|fy.||7 - \v.\Ux} > 

which, together with (14.31) . (14.4L (14.51) and (14.71) . implies that 

k 

c= lim I{un) =I{uo) + 

n—^oo ‘ ^ 

(a5)^ a652||Mo|p 

-lll-oll 

{aSr 


(4.6) 


(4.7) 


-4^^ “^ 4(5-652) ' 4(5-652) 


4 


652 A 

4(5-652) ' 4 V5-652 

(a5)2 a/ 5 5 n iis 

^4(5-652) 4 I 5-652 “ Ta)"/ 

(a5)2 


-4(5-652) 

since A < aAi5/(5 — 65^). This contradicts 0 < c < (a5)2/(4(5 — 65^)), and then we complete 
proof of this lemma. | 
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Remark 4.1 Our case of A > oAi is quite different from the case of A S (0,aAi) assumed in [25] 
since, except for the indefiniteness of the operator —A — aA, it is not obvious whether /(mq) > 0 
or not from (14.41) . and now it follows from (14.61) that 


,2 . A2|0| 


5^ < 


which is also different from the assumption given by [251 Lemma 2.1]. 


(4.8) 


To prove Theorems 11.21 and 11.31 we will find two suitable closed subspace V and W with 
V n W ^ {0} and V (BW = H such that the functional I satishes the condition (oi) — ( 03 ) of 
Theorem 12.11 with /3 = (a5)^/(4((5 — bS^)). 

Given a, X, p > 0, we set 


A+ = min{Aj : A < aXj}, A = max{Aj : aXj < A}, 

Hi = H 2 = M{Xj), Rp = {x G : |x| < p}. (4.9) 

Without loss of generality, we can suppose that 0 G and that Ri(0) C fl. Given e > 0, let 
Ug{x) be the function given by (123D, we define 


'^e{x) = (j){x)Ue{x), 


where (j) G C(j“(Ri(0)) with (j){x) = 1 in Ri/ 2 ( 0 ). Similarly as in [5113], we have the following energy 
estimates of 

Lemma 4.2 


=52 + 0(£); 

(4.10) 

||vI/,||4 = 52^0(£2). 

(4.11) 

||5'e|| 2 > Riel loge| +0(e). 

(4.12) 

ll^-elli <R2e5, 

(4.13) 

ll^'elli < Ksei 

(4.14) 


Set j = max{j : Xj < A} and denote by Pj the orthogonal projector onto the eigenspace M{Xj) 
corresponding to Xj . We now set 

^ J 

4-, = (4.15) 

i=i 

and give some energy estimates for 4 'e in the following lemma. 


Lemma 4.3 For e > 0 sufficiently small, we have 




1 




a||4/,||2-A||vI/,||i 


I'I'slll 


= aS + Celoge + 0(e), 


where C > 0 denote variant different constants. 


(4.16) 


(4.17) 

(4.18) 


12 





Proof. Since {(fij} be the orthogonal eigenfunctions corresponding to Xj spanning M{Xj), i = 
1,2, • • • ij, where ij = dimM(Aj), then 


I ^ij^kndx — 
JQ 


1 , ii i = k and j = n, 
0 , others. 


(4.19) 


Since 4'^ G Hq{V,) and = 1, 2, • • • ij] j = 1, 2, • • •) is a family of orthonormal basis of Hq{Q), 


there holds 


then we have 


OO '^j p 


j=l i=l 


Pj'^e{x)=^( / 4-, 




(4.20) 


(4.21) 


On the other hand, recalling that ipij G (^“(O), we see that there exists C > 0, dependent of j, 
such that sup{(/9ij(a;) : x G O, * = 1, 2, • • • ij} < C, therefore, by (14.131) and (14.211) we know 


3 p 2 

\\Pj'^e\\l = i2{ 'i'e^^Jdx) <C(^||(^.,||L)||^.||?<q|^e||?<C£. (4.22) 

i=i dn 

Similarly, we also deduce 

\\i2P^'^-\\2 = i2\\P^'^-\\2<Ce, (4.23) 

1=1 1=1 

ll-Pl^'elloo < X! ( / '^e^ijdx'^ ||‘/?il(a:)||oo < C'll^'elll < 

i=l 

3 3 

\\^Pj'feU = ^\\Pj'i'e\\oo<Cei. 

1=1 1=1 

Thus (14.161) and (I4.17|) hold. Furthermore, we have, by (14.141) and (I4.23p . 


i\^e\^-\^e\^)dx 


which implies that 


=4 


<32 


n lo 


IQ Jo 


4/, - t ^ P,4/, I' (4/, - t ^ P,4i,) ( ^ P, 4/,) 

1=1 

tc,*.n(tr,®.) 


dtdx 


1=1 

4'J" + It 


1 , . J 

3 


1=1 
) dtdx 


1=1 1=1 
1 


<32(||4-,||3||^P,.4/,|U + ||^P,4/, 
1=1 1=1 


E||4 


<32 (II 4 /, ||3 II ^ p,. 4 /,lU + II ^ P, 4 /,Hi II ^ P, 4 /, 

1=1 1=1 1=1 

<C{e + e^). 


||4/,||t = 1141,11}+ 0(e). 


elloo 


(4.24) 
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It follows from (|4.19L (14.201) . (14.211) . (14.221) and (14.231) that 


||4/,f=/ V4 /,-£v(P,vI/,) 


i=i 


dx 


iVvh.p -2^ VvI/,V(P,vI/,) +£ |V(P,VI/,)| }dx 
i=i i=i 

J 2j ji 

ll^ef -2 'i’e^ijdx J V'i/e'^^ijdx + 


t=l i=l ■ 

7 *j 


j=i i=i 


\Vipij\'^dx 


4'eV?iida:) 

j = l i=l 




i=i 


sill 




i=i 


da; 


s„l 


s„l 


-2j2'^4P,^,) +j2\{Pj'i'e)f}dx 

i=i i=i 

«!:(/ +ti: 

j=i i=i .... 

7 . 


i=i i=l 


i=i i=l 
j 


enl 


i=i 

Combining (14.24^ . (14.251) . (14.261) and (I4.10|) - (l4.12p of Lemma 14.21 we obtain that 

all^elP - All^elll all^elP - Alld/.lli + - aA,)||P,vi;,||2 


sill 


e\\A 


2 + 0{e) 


a||4/,|p-A||4/,||i + 0(g) 

\\'i>e\\l + 0{s^) 

a||4/,|p-A||vI/e||i , 

|2 


- £||4 

=aS + Ce loge + 0{e), 


(4.25) 


\ipij\‘^dx (4.26) 


then (I4.18P is proved and this completes the proof of the lemma. | 

Let 77i and H 2 be given in (14.9|) . Clearly 'f'^ defined by (14.151) belongs to Hi. Now we define 
a subspace We in i7o(f2) as 


We = {u € Pq (fl) : U = U + t'^e, U G H2,t € 
then we have the following result: 


(4.27) 
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Lemma 4.4 Suppose that a, A > 0, then for e > 0 sufficiently small, 


li— 

Mew^e\{o} 11“ 




^2- 


i=i 


Proof. By the definition of We and the orthogonality of Hi and H 2 , we know that for each 
u € We, u = u + t'i'e for some u G H 2 and t gM., and 

\\u\\^=\\u + me\\^ = {\\u + t^eff<2\\uf + 2\\me\\^. (4.28) 


Since 


ll'^lloo ^ C, ll^elloo 


= ||4'e-^Pj4'e||oo < ll^'elloo + II^Pj^'eIIoo < 8e + CsK 


J = 1 


i=i 


we have 


so that 


u(t^e)^dx < |t|" 


u'^edx 


= 0, / u'^{t^e)dx = I m{t'^erdx = 0, 

Jn 


\u\\\ = f \u + 


= / {\uf + iu-^ime) + Qu^lyt'iter + + \t'ite\ )dx 

Jn 


= m\t+\\t^e\\i 

Therefore, by using (14.281) , (j4.29l) and Lemma 12.11 we see that 


(4.29) 


ur , 2||llf+ 2||tT,||' 


sup ^ < sup 

MGWe\{0} ueTVe\{0} I|w|l4 + 11^4'eIII 

„ r l|u|l^ p^ell 

<2max<i sup t— p, - 


=2 max < sup 


■eff2\{o} linin' ||i4'e|||J 
u||4 54 + 0(e) 


Meff2\{o} *S^ + 0(e^) 




(4.30) 


On the other hand, for each u G H 2 \ {0}, there exists {c^} C M (j = 1, 2, • • • , j; i = 1, 2, • • • , ij) 
such that 

j b 

^=EE Cij ^ij 1 
i-1 

where {^ij} is the family of orthonormal basis of Hq{VI) given in the proof of Lemma l4.3l Therefore 
we have 


wi‘ = 


{Y.t (i:>>)'(i:5: \\C-ij^Pij II 


i=l i=l 


i=i i=ii=i 


0 




= EE 


j=l i=l 


By using Lemma 12.11 again, we get 


sup 


< 


iieff2\{o} ll^lll 


(E*j) 




i=i 




= * = 1,2,... ,i,}. (4.31) 

Ull4 ^ 
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It follows from (|4.6L (14.301) . (14.311) and (14.81) in Remark HTT] that 


||m||4 „ (S^ + 0{e) 

sup Tr-fTI ^2maxl — 




( 2 : 4 ) 


i=i 

7 


j ^ 2 ■ ■ ■ i 7 — 12 

II 1145 J J 1 ^ 

mm 




<2 max ■ 


(E*.)V.noi, 7 - 1 ,v.j} 

i=i 
2A2 


<2|r2| ^ ij'j 


7=1 


for e > 0 sufficiently small. | 


Lemma 4.5 Suppose that a > 0 and A G [aAi, aAi(5/((5 — bS^)), then for e > 0 small, 

^ ior^' 

provided one of the following conditions holds 

(1) 6>0,b>0is sufficiently small; 

(2) b > 0, S > 0 is sufficiently large. 


Proof. First of all, let (5 > 0 be fixed, we may choose 5i > 0 such that for each b G (0, 61 ), it holds 

aAi5 


< aX2, 46A2|fI| < S, 


6-bS^ 

thus II 2 = M{Xi). It follows from Lemma [4.41 that there exists eo > 0 such that for e G (0,eo) 


(4.33) 


sup 

ueWAfo} 


< 2A^|0|. 


For each u G W^, we we may assume that a||w||^ — A||m|P > 0 (since otherwise I{tu) < 0 for all 
t > 0, which implies sup„g-j^^/( m) < sup^^g-j^^ maxt>o< 0: so that the desired inequality 
(14.321) holds trivially), hence I{tu) > 0 for t > 0 small, and 


4(,5-6g^)||w||| - 2bXl\n\)\\u\\t 

Next, we claim that 

sup{a||M|p — A|1 m||2 : u G ||u ||4 = 1} < oiS + Ce\oge + 0(e) 

holds for some positive constant C and small e. 

Indeed, for u G We with IImIU = 1, we have 


(4.34) 
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then by (14.241) . we see that t is bounded and < 1 . Therefore, by using Lemma H31 

a||n|p - X\\u\\l =a{\\ur + \\t^e\\l) - A(||«||^ + 

=«l|w|p - A||u||2 + - M\t^s\\l 

all^elP - 


— (oAi — A)||u||2 + 








< 


a||vI/,||2-A||4/,||i 




<aS + Ce loge + 0(e). 


(4.35) 


It follows from (j4.34|) and (14.3511 that 


sup I{u) < 

UGWs 


(aS)^ + Ce log £ + 0(e) 

4(S-2bAllQI) 


65^(2A2|0| — <S^) Ce log e + 0(e) \ 

^TU-552 (S - bS^)(S - 2bAljnj) <5- 26Ai|n| / 
465^(2A||0| — 5^) Celoge + 0(e)\ 
-TU-552 52 + j 


so that there exists ei > 0 such that for each e € ( 0 , ei), we can find bg := bo(£) satisfying that for 
each b G (0, bg) the inequality (j4.32j) remains true. 

Finally, if 6 > 0 is fixed then (14.3311 obviously holds for all large 5 > 0. Similarly as in the 
above, we see that (|4.32l) also holds for all large i5 > 0. Thus we have proved this lemma. | 


Remark 4.2 In Lemma lT5l we have shown that the assumption ( 031 ) of Theorem 12. 1 1 holds with 
W = We and /3 = (aS)^/(4(S — bS^)), the choice of /? is consistent with Lemma [4.11 However, 
by checking the proof of Lemma lT5l carefully, we observe that the conclusion of Lemma lT5] is still 
true if we take the place of (aS)^/(4(S — bS^)) by (a5)^/(4(5) — tr for some cr > 0 small. Indeed, it 
follows from (14.341) and (14.351) that 


sup I{u) < 

U^Ws 


<- 


(aS)'^ + Ce log £ + 0(e) 

4(5-26Ai|H|) 

0 ^/ 5 ^ 2bS^Al\n\ 

'TVT S(S-2bAl\n\) (5- 26A||0| 
52 4bS^Al\n\ C£\og£ + 0(£)' 

T 52 + 


Ce loge + 0(e) 


46 


since for e sufficiently small, we can take b e ot 6 large enough. 


Lemma 4.6 Suppose that a, 6 > 0. Let {5„} and {A„} be two sequences of positive numbers 
satisfying —>■ 0 and A„ oAi as n ^ 00 , where A„ > aAi for all n G N. If Un is the solution of 
Eq. (11.31) corresponding to bn and An and {/(u„)} is bounded, then {un} is bounded. 


Proof. Arguing by contradiction, we may assume ||Mn|| ^ 00 as n —>■ 00 . Let = it„/||Mn||, it 
is easy to see that ||wn|| = 1, and then there exists wg G Hg(Ll) such that Wn wg in Hl(W} and 


17 

































Wn —>■ wq in LP{il) (1 < p < 4) as n ^ oo, thus we have 

a 


0 = 


r{Un)Un a . Anilw, 




bn. 


||Mn 


-S\\Wn\\i 


which implies that ||u;n ||4 —> 0 as n —oo, therefore we obtain wq = 0. On the other hand, 


(^n)^n Cl 

4 “ T 


«(1) = = 7 - = 7 + «(!)> 


we obtain a = 0, this is a contradiction since a > 0, therefore {un} is bounded in 


Lemma 4.7 Suppose that a > 0, b > 0 and A > aAi. Let 0 < S < bS'^. Then Eq. ()1.3I1 has a 
positive ground state solution u G H^iLl) with I{u) < 0. 


Proof. Let tpn be the positive eigenfunction corresponding to the first eigenvalue Ai, then we 
see that 

a-WTiif - Allv^iilll = (a - < 0 and - 5\\g}xi\\\ > {b - ^)||</ 5 iif > 0 

since A > oAi and 0 < 5 < bS^. Therefore, 

Htifii) =-\\tipii\\'^ + -|lt</?ii||^ - 

= \ia - + libWTiiW^ - S\\^i^\\t)t^ < 0 

for t > 0 small, i.e., there exists to > 0 small such that /(toV^ii) < 0. On the other hand, 

Hu) =^\\uf + - ^||m||2 - ^I|m||4 

>(a - ^)l|w|P + {b- +00 

as ||it|| —?► oo, which means that / is coercive. Let c = inf{/(tt) : u € i?Q(0)}. By the Ekeland 
variational principle (cf. [32l Theorem 2.4]), there exists {PS)c sequence {u„} of I. Clearly, 
—oo < c < 0 and {u„} is bounded. Then by ProDOsition l2.1l and (12.51) . there exists u G i/g (n)\{0} 
such that —?> M in i7g (ft) as n —>■ oo, up to a subsequence. Therefore, u is a ground state solution 
of Eq. (11.31) satisfying I(u) = c < 0. Noting that /(|u|) = L(u), so that |u| is also a global minimizer 
of / on i7g(n), in this way we have that \u\ is a ground state solution, then |u| > 0 because of the 
maximum principle, therefore we obtain a positive ground state solution. | 


Lemma 4.8 Assume that a > 0, b > 0 and 0 < 5 < bS^ with A > oAi. Let {An} be a decreasing 
sequence satisfying 6n —> 0 as n ^ oo and let Un be the positive ground state solution corresponding 
to 6n, then {u„} is bounded. 


Proof. Arguing by contradiction, we assume ||un|| —>■ oo as n —>■ oo. Set Wn = Un/||Mn||, then 
||wn|| = 1 and there exists wo G such that lUn wq in JLq(^) uin —^ wq in LP{Q) 

(1 < p < 4) as n —>• oo. Clearly, ||iro|| < 1- Denote Cn := I{un). It follows from L'{un)un = 0 that 


lim 

n—foo 


Cn 


llWn 


lim 


I{Un) 


nl {Un)Un, 

Ik# 


lim ^1 

n^oa 4 


b 

4 
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On the other hand, 


Cyi I{Un) ('^n)'^n d A 

11— 1 I 2 = -M—112-= 7 “ ™ 7 

n^oo lirj n-^00 lirj 4 n-^00 4 


l^ = j-jlK|g. 


Thus we get a contradiction since ||u„|| ^ oo as n —)■ oo. Therefore, {«„} is bounded. 


Lemma 4.9 Under the assumptions of Lemma \4-.8\ and let Cn '■= I{un), then Cn —>■ d as n ^ oo, 
where d := inf{J(u) : u G i/g(f2)} < 0, J{u) = —||u|p + -||m||"'’ — is given by (I3.1|) . 

Proof. By Lemma ITSl we see that {u„} is bounded, then {c„} is also bounded. Clearly, {c„} 
is nondecreasing on n, thus c„ —cq for some cg G K as n ^ oo. Obviously, the functional J is 
coercive, weakly low semi-continuous and 

- ^)\\^pii\\h^ -f ^ll^iillV < 0 

for t > 0 small since A > oAi. Therefore, there exists v G iJg (O) \ {0} such that 

d = J{v) = inf{J('u) : u G iJQ(f2)} < 0. 

It follows from Lemma [4.71 that Cn < d since I{u) < J{u) for each u G i^g(0) and Sn > 0, hence 
we get cg < d. If cg < d, then there exists ng G N such that for each n > ng, 

7 ^ 7 / N 7/ \ I II ||4 I II I|4 ^ I ^ ^0 ^0 ^ ^ j 

d < J{Un) = I[Un) + -^\\Un\\i = Cn + —||m „||4 < Cg H- - - = - - - < d 

since (5„ —>■ 0 and {ti„} is bounded, this is a contradiction. Therefore, we must have cq = d. | 

Proof of Theorem 11.21 

Suppose that 0 < <5 < bS^. If Eq. (11.31) has a nontrivial solution u for each A G (0, oAi] then 
0 = I'{u)u =a||u|p -I- - A||m ||2 - d||M ||4 

this is impossible, therefore, Eq. (IE31) has no nontrivial solution for A G (0,aAi]. 

Now we assume that a > 0, 6 > 0, A > aAi and 0 < d < bS^. Then it follows from Lemma I4J1 
that Eq. dis has a positive ground state solution. 

Assume that A G (oAfe, aAfc+i] with fc > 1. Let {dn} be a decreasing sequence satisfying —)> 0 
as n —>• 00 . Let Un be the positive ground state solution corresponding to Sn- Lemmas 14.81 and 14.91 
show that 

J{Un) = I{Un) + ^||Mn||4 = Cn + ^||Mn|l4 Cg = d 

as n ^ 00 , i.e., {m„} is a minimizing sequence of J. Then there exists 0 < ug G idg(fl) such that 
Un Mg in idg(n) and m„ —?► Mg in LP{fl) (1 < p < 4) as n —>■ 00 . Therefore, we have 

d < J(Mg) < lim J(un) = d, 
n—¥oo 

i.e.. Mg is a global minimum of J and then Mg is a positive ground state solution of (El because 
of the maximum principle. It follows from Step 1 in the proof of Theorem II.II that Mg = mi, where 
Ml is given by (13.211 with j = 1. | 
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Proof of Theorem ll.3t 

(i) We set V = Hi and W = We (see (14.271) ') with e so small that (14.321) holds. Clearly, the 
assumptions (oi) and ( 033 ) of Theorem 12.II are satisfied. It follows from Lemmas 14.11 and 14.51 that 
( 02 ) and ( 031 ) hold with /3 = (aiS)^/(4((5 — bS'^)). If m € 14 such that HmH = p with p > 0 small 
enough, then 




5_ 

4 


4 

4 





4 


> 0 

for some positive constant kq, that is, the assumption ( 032 ) of Theorem 12.ll is also satisfied. Since 
dim(I4 n W) = 1 and V = i7g(f2), by Theorem 12.11 we get that Eq. (11.31) has one pair of 
nontrivial solutions with the corresponding functional energy in [kq, (a5)^/(4((5 — bS^))). 

We claim that the solutions of Eq. (HU obtained by the above are all sign-changing. 

Indeed, otherwise, for the case of (1), we may assume that there exist { 6 „}, {A„} with > 
0,A„ > oAi, bn ^ 0, A„ —>■ oAi as n ^ 00 and the corresponding solutions {u„} with > 0 for 
all n S N. By using Lemmawe see that {un} is bounded. Recalling that the energy functional 
of (11.61) is defined as 

h{u) = - ^||n||^ - ^IHll u G 

we deduce from Theorem 12.11 and Remark 14.21 that for n large enough, 


0 < Y ^ 4(Mn) = I{Un) 




4(5 


which, together with Lemma HU implies that Io{un) ^ cg G [Kg/2, (a5)^/(45), up to a subse¬ 
quence. On the other hand, for each v G iLQ(O), 


^ (An uAl) / TLnXdx — o(l), 

Jn Ja 


dni^n^lln — I {Un'jUn ^n||'^n|| (An uAl) / Undx — o(l), 

Ja, 

therefore, by using the standard arguments in lilMlISl], we obtain that there exists Ug G 17g(0) \ 
{ 0 } such that Un —> uo in as n — 5 - 00 , up to a subsequence. 

Let ipii be the positive eigenfunction of the first eigenvalue Ai, then we have 


0 ={a + bnWUnW"^) / VUnVpiida; - An / Un^lldx - S / \Un\‘^Un(pildx 


=6nAl||Un|P / - (An - aAi) / Unipildx - S / \Un\'^Un<filldx 

= (6nAl||Mn||^ - (An - aAi)) / \Un\(pildx - 5 / \Un\^iflldx 


<o(l) — (5 / \uQ\^Lpiidx < 0 , 

Ja 


this is a contradiction, so that our claim is true for the case of (1). For the case (2), we observe 
that if M is a solution of (HU, then V = is a solution of 


b f 

“(a+T / \^v\^dx)Av = Xv + 
0 Ja 




u = 0, 


in n, 
on 90, 
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then by using similar arguments as above, we can show that v is sign-changing if 6 large enough, 
so that u is also sign-changing. 

(ii) We now prove the asymptotical behavior of the solutions as 6 —>■ 0. Fix a, <5 > 0. Let {bn} 
and {A„} be two sequences satisfying > 0 and A„ —> aAi as n —> oo with A„ > oAi. Let 
be the solution corresponding to and A„ obtained above, it follows from Lemma [4.61 that {m„} 
is bounded. Similarly as in the proof of the above claim, we see that Un ^ uq ^ 0 in i^o(Al) as 
n —>■ oo and Iq{uo)v = 0 for all v G that is, ug is a nontrivial solution of Eq. (11.61) . A 

standard argument (cf. [ 6 ]) shows that ug is a sign-changing solution of Eq. (II. 6 |) . | 

5 Proof of Theorems 11.41 and 11.5 

In this section, we are investigating the existence of solutions of Eq. (EB) for A > aAi and 2 < g < 4. 
We regard Eq. EH) as a perturbed equation of the following equation 

(—aAu = X\u\'^~‘^u + Slul'^u, in 

(5.1) 

u = 0 , on dfl, 

then the corresponding functionals for Eq EB and Eq. (EE) can be respectively written as 

'Ib{u) = ^\\u\\'^ + j\\u\\^ - - f \u\‘^dx-j f \u\^dx, 

2 4 q 4 

and 

/o(m) = ^||u|p — — f \u\'^dx — ^ [ \u\'^dx. 

2 <1 Jn 4 Jq 

It follows from [5] (see also [55]) that Eq. EE has a positive ground state solution ug G H{(Q), 
thus we obtain 

a||uo|P = A f \ug\'^dx + S f \ug\^dx 

Jn Jn 

and 

'loM = ^-;^a\\ugf+ ^—^6 [ \ug\‘^dx. (5.2) 

2 g 4g 

Moreover, ug is a mountain pass solution and Ig possesses the following properties: 

(Ml) there exist c, r > 0 such that if ||u|| = r then Ig{u) > c and there exists uo G iLo(f2) such 
that ||wo|| > r and Ig{vg) < 0 ; 

(M2) there exists a critical point ug G of Ig such that 

7g{ug) = Cg := min max 7g{j(t)), 

76 r tG[ 0 ,l] 

where F := {7 € C([0, l],H}{n)) : 7 ( 0 ) = 0 , 7 ( 1 ) = uq}; 

(M3) 0 < Co := inf{Io(u) : I'giu) = 0,uG H{{^) \ {0}} < (a5)^/(4(5); 

(M4) the set S := [u G : Ig{u) = 0, Ig{u) = cq} is compact in Hq{Q); 

(M5) there exists a path 70 S F passing through ug at t = tg and satisfying 

7g{ug) >7g{jg{t)) toi a\\ t ^ tg. 


21 









In fact, we can take vq = Tuq with T > y/q/2 in (Ml), and set 7o(t) = tvo with to = 1/T in 
{Mb). It is easy to verify that (M2) and (M3) hold. To check (M4), let {u„} C S' be a sequence, 
we deduce from (I5.2|) and the definition of S that {u„} is a bounded (PS) sequence of /q at the 
level cq. Noting that cq < (aS)^/(4i5), by using the arguments of [ 6 l [28], we see that /q satisfies 
the Palais-Smile condition, and then there exists mq £ i^o(^^) \ {0} such that uq in Mq(0) 

as n —> oo, so that Io{uo) = cq and Uq £ S. 

A nature way to construct a (PS)c sequence of It with c < (aS)^/(4(5 — &S^)) can be processed 
as follows: let uo £ ^^o(^^) be as in (Ml), since Ib{vo) < 0 for 6 > 0 small enough, it is easy to 
show that Ib has the mountain pass geometry and hence there exists a sequence {m„} C ^lo(ll) 
satisfying Ib{un) — > Cb and Ib{un) —^ 0 in H~^{Q), where 


Cb = min max Ibilit)) 

7erte[o,i] 

and P is defined in (M2). Let 6 > 0 be so small that we have the following estimate of Cb'. 

— — bT^ 

Cb < max Ib{tuo) < max Io{tuo) H-IImoII"^ 

te[o,T] ie[o,T] 4 

hT^ 

=co + —lluof 

(a<S)^ {aS)'^ 

^ 4.5 ^ 4((5 - 652) ■ 

However, we are not sure whether the (PS)c 6 sequence of the functional Ib has a convergent 
subsequence in iLg(r 2 ) or not because the exponent of the nonlocal term ||u||'^ is equal to the 
critical Sobolev exponent when = 4, which leads to the difficulty of proving the boundedness of 

{Un}- 

We borrow ideas of [3 (Hill HD] and define a modified mountain pass level of by 


Cb := min max Ibilit)) 

7erMte[o,i] 

where 

rM:={7£r: sup || 7 (t)|| < Af} with M = 2r||'Uo|p. (5.3) 

tg[o.i] 

It follows from the choice of M that 70 £ Pm and cq = ming,grM maxjgjg loiiit)), where cq and 
7 o are respectively given in (M3) and (M5). Moreover, we have the following result: 

Lemma 5.1 The mountain pass level Cb is continuous at 0, i.e., limf,_>o Cf, = Cg. 


Proof. Clearly, Cf, > cq holds. It follows from (M5) that 


_ _ bT^ ^ 

Cb < max Ibitvo) < max hituo) H-llwoir 

i<t<i i<t<T 4 " " 

=co+^ii«or 

=co -I- 0 ( 1 ) 


as 6 —>• 0 . I 
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Given d > 0, a set A C Hq{Q) and a point u G i/Q(f2), we denote 


Bd{u) := {v G : Ik - '“II < d,}, := (J Bd{u). 

u^A 


Lemma 5.2 Let S be given in (iV/4). For fixed d > 0, if a sequence {uj} C S then {uj} converges 
weakly to some u € S as j ^ oo, up to a subsequence. 

Proof. By the definition of S‘^, there exists {vj} C S such that \\uj — Vj\\ < d for all j G N. It 
follows from the compactness that there exists v G S such that {ri^} converges strongly to v in 
i/Q(n) as j -A oo, up to a subsequence, so that \\uj — u|| < 2d for large j, that is, {uj} C B 2 d{v) 
for j large enough. Since B^div) is weakly closed in HI[VL) and {uj} is clearly bounded in Hq{Q), 
we get that there exists u G 5^^ such that Uj ^ u as j ^ oo, up to a subsequence. | 


Remark 5.1 By the definition of S in (M4), we see that there exists a positive constant C such 
that ||m|| > C for all u G S' since, otherwise, we must have a sequence {««} C S such that Un ^ 0 
in ffg ( fl ) as n — >■ oo, which yields cq = 0, a contradiction with the definition of cq. Therefore, we 
may choose a d > 0 so small that u 0 for all u G S^^. 

Lemma 5.3 Assume that { 6 j} is a sequence of positive numbers with bj —> 0 as j —^ oo. Let d > 0 
be small enough and let {uj} G S be such that 

\im IbAuj) < Co, \im l[{uj) = 0. (5.4) 

j—^OC ji—>-oo ^ 

Then {uj} strongly converges to some u G S, up to a subsequence. 


—2d 


Proof. By Lemma lOl and Remak lSTTl up to a subsequence, we get that there exists u G S such 
that Uj ^ M in Hq{TI) as j —?► oo and m ^ 0. It can be deduce from (15.4|) and the boundedness of 
{uj} that for all v G iLg(n), 

to{u)v =a [ VuVvdx-X [ \u\‘^-^uvdx - S f \u\^uvdx 

J Q. J Q, J Q, 

= lim a / VujVvdx — X / \uj\‘^~'^Ujvdx — 6 / \uj\'^Ujvdx 
Ja Jq Jn 

= lim Ib.{uj)v — bj\\uj\\'^ / VitjVuda; = 0, 

^ Jn 

hence Io{u) = 0. Furthermore, since {uj} C S*^, we obtain that 


loM = - bjWujW^Uj = o(l). 


On the other hand, 


Co > lim Ibfiuj) = lim Io{uj) + lim 5j|kj|k = lim Io{uj) '■= w. 


J—>-oo 3^00 


(5.5) 
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then {uj} is a {PS)m sequence of Iq. Therefore, up to a subsequence, 

Io{u) [ \\7u\'^dx — — [ \u\'^dx — 7 / \u\‘^dx 
= ^ / iVupdx + —^(5 / |u|'^da; 

2? Jn 4q Jfj 

< lim —a [ \VuA'^dx-\ - -r-^S [ lujl'^dx 

j-yoo 2q Jq 4q Jq 

= lim (lo(uj) - -to{uj)uj) 
j->oo q 

=m. 

It follows from (M3) and (|5.5D that m = Io{u) = cq, which implies that u € S. A standard 
argument (cf. [BJUS]) shows that Uj —)• it in Hq{V,) as j —)• oo. | 

Now we set Db := max{/ 6 ( 7 o(t)) ; 0 < t < 1}. Clearly, Cb < Db and moreover, it holds 
lim{,_>o Db < Co, so that, by Lemma [O] we have 

lim Cb = lim Db = cq. (5-6) 

b->0 6^0 

The following Lemmas I5.41I5.6I are quite analogous to Propositions 3-5 in [^. However, some 
arguments in |20) are based on the assumptions that the perturbation operator is compact, which 
is not our case here, therefore we prefer to give the modified proofs for sake of completeness. 

Lemma 5.4 Let di > d 2 > 0 be two small constants, then there exist positive numbers a and bo 
depending on di and d 2 such that for each b € (0, bg), the following is true: 

||.fh(w)|| > a for all u & I b'’ {S ^ \ S ^), 

where = {it G Hq{D) : Ib{u) < Db} as usual. 

Proof. Argue by contradiction, we may suppose that there exist a sequence {bj} of positive 
numbers with linij^oo = 0 and a sequence of functions {it^} C n \ S'^^) such that 
limj_^oo Ibj i'^j) = 0. Then by (15.61) . we obtain that limj^oo Ibj (uj) < cq. It follow from Lemma [5731 
that there exists u € S such that itj —)> it in Mq (H). As a consequence, dist(itj, S') —?> 0 as j —)• oo, 
this contradict Uj ^ S ^. | 

Lemma 5.5 Let d > 0 be fixed. Then there exists (5 > 0 such that ifb>0 small enough, 

t G [0,1] and 7h(7o(t)) > Cb - 6 ^ 7o(t) G S"*. 

Proof. Since the proof is quite similar to that of [20]. We omit the details. | 

Lemma 5.6 Let d > 0 be a small constant. Then there exist b > 0 sufficiently small, depending 
on d, and a sequence {uj} C S (~l If, *" such that Ib(uj) —)■ 0 as j ^ oo. 
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Proof. Arguing by contradiction, we may assume that there exist two sequences {bj} and {cj} 
of positive numbers with bj —>■ 0 such that ||/^^. (m) || > Cj > 0 for all u G Cl . By Lemmas 15.31 
and 15.41 there exists some a > 0, independent of j, such that 

_/ _n. _^ _ d 

||4j(u)|| > a for all uGl^.^ n{S \ S^), 


which gives that {cj} has a positive lower bound. Moreover, there exists k > 0, independent of 
j, such that (m)|| < k for all u G S'^ since S'^ is bounded in iLg(O). By using Lemma 15.51 and 
(15.61) , we can choose (5 > 0 so small and j so large that 


t G [0,l],/b^.(7Q(t)) > Cb 


s _ ^ 

- implies 70 (f) G 


(5.7) 


and 


Db, -Cb, <2 and Db, - Cb, < — 


5_ 

4' 


(5.8) 


From now on, we fix a j so large that (IE3 and (15.811 are true, and we denote bj just by b. 
Now, consider a pseudo-gradient vector field 14 of /& and a neighborhood A4 of S‘^ 141^'’ satisfying 
Mb C Bm{0), where M is given by (15.31) . We observe that Db < M for b small enough. 

Let us respectively define two functions rjb G [0,1]) and ^b G (^^’^(R, [0,1]) by 


1 , onS‘^nlb\ 

0, oniJo(fl)\A4 


and 


6(t) 


1, if|f-C 6 |<-, 

0, if \t — Cb\ > S. 


Then it is clear that the following Cauchy initial value problem 




dt 


ipb{u,t) 


-r]b{ipb{u, t))^b{Ib{'tpb{u, f)))14('0h(u, t)), 


V’&(u, 0 ) = u 


has a global solution '0b : Hl{Vt) x R i7o(n) since r]b and ^bO Ib G C'^’^(iLo(f^), [0,1]) and 14 is 
locally Lipschitz continuous. 

Now we claim that for all t G [0,1], /b(0b(7o(f),ffe)) < Cb — <5/4, where tb ■= 5/{2(?). Indeed, if 
for each t G [0,1], there exists to < h such that /b('0b(7o(f), fo)) < Cb — <5/4, then we get the claim 
since it follows from 

-^Ib{il^b{lo{t),T)) < -Vb{i’bho{t),T))^b(lb{il^b{lo{t),T)))\\l'b{ipb{lo{t),T))f (5.9) 

that 

7b{i’b{'lo{t),tb)) < Ib('0b(7o(f),fo)) < Cb - 
Otherwise, there exists some t G [0,1] such that 

7b{'ipb{'-fo{t),T)) > Cb - - for all T e [0,4]. (5.10) 
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Thus by (|5.7L we have 


7 o(<) = ilJb{jo{t),0) e and ^b{Ib{'‘l^b{'lo{t),T))) = 1 for all r e [0,4]. 

If '(lbbiloit),T) € S‘^ {Wt G [0,4]) then it follows from (15.8p and /t,('(/'b( 7 o(f), t)) < /t,( 7 o(t)) < 4>t, 
that r]t{ipb{jo{t),T)) = 1 (Vr € [0,4]), which, together with (15.911 . implies that 

< -c^ 


where c := Cj for the above fixed j. Thus we obtain 

7bii’biioit),tb)) = j ^7bii>bijo(t),T))dT + 7bijo{t)) < Db 


c^dr = Db — tbC^ < Cb 


5 

4’ 


a contradiction with (15.101) . Therefore we must have 'il}b{lo{t),Ta) ^ S'^ for some tq G [0,t6], so 

_ d _^ 

that there exist ti,T 2 : 0 < ti < r 2 < tq satisfying '0b(7o(t), n) G dS^, '06( 70 (f),'’" 2 ) G dS and 

_ d _ d 

06(7o(f),'7') £ S \ for all r G (ti,T 2 ). It is not hard to show that r 2 — n > d/{4k) since, 
otherwise, we shall get, by the definition of pseudo-gradient vector field, that 

^ =ll' 0 b( 7 o(f),T 2 ) - 06 ( 7 o(f),ri)|| = II J ^' 06 ( 7 o(f),'r)dT|| 

-J - / ll 4 ( 0 fc( 7 o(f),T))||dT < y 2fcdr < ^, 

this is impossible. Thus, from (15.81) and (15.91) . we obtain 


Ib{lpbi'Joit),tb)) <Ibii^bi'Jo{t),T2)) =y ■^Ibilpb(,'jQ(t),T))dT + Ibijoit)) 


< 


■^Ib{tpbi'loit),T))dT + hijoit)) < Db- a^{T2 - n) 
dr 


da^ S 

<Db -7^ < ~ 71 

4fc 4 


a contradiction with (I5.10|l again. Hence we have prove the claim. 

Finally, we set 7 o(t) := '0b(7o(f),4)- Then 7 o(t) G Tm and Ib{joit)) < Cb for all t G [0,1], this 
contradicts the definition of Cb- Thus we complete the proof of this lemma. | 


Proof of Theorem 11.41 

Let us fix d > 0 small enough. By Lemma EH (EH and (M3), we deduce that there exist 6 > 0 
sufficiently small and a (PS) sequence {un} of If, with {m„} C 4^ (~I/j and Db < (a5)^/(4i5) < 
(a5)^/(4((5 — bS^)). It follows from the (15.21) . (M3) and the definition of S‘^ that {u„} is bounded 
in Mg (H), in particular, ||Mn|p < 1 -I- {aqS"^)/{2S{q — 2)) for all n G N. Therefore, there exists c > 0 
with c < (a5)^/(4i5) < (a5)^/(4((5 — bS'^)) such that Ib{un) —>■ c, up to a subsequence. Next we 
will show that there exists uq G S' such that Un —>■ uo in Hoi^) as n —>■ 00, up to a subsequence, 
provided one of the three conditions (C'1)-(C3) holds. Arguing by contradiction, if {un} has no 
convergent subsequence in iLo(H) then by Proposition [2H there exist a weak limit uq G Hg (O) of 
{un}, a number fc G N and further, for every i G {I, 2, • • ■ , fc}, a sequence of values {Rh} C M"*", 
points {ccjj} C ft and a function Vi G X>^’^(IR^) satisfying (12.61) . (12.71) and 

k 

7b{un) = Ib{uo) -t- ^7“(uj) -b 0 ( 1 ) 
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up to a subsequence, where o(l) —> 0 as n —>■ oo, and are respectively given by (12.81) and 
(1^ . On one hand, by (I2.6|) and (12.81) . we have 


k 

7b(ito) =76 (wo) - i((a + 6(||uo|P + ^ ||ui|||,i, 2 ))||Mor - A / \uQ\‘idx-5 [ \uo\‘^dx 

4 ^ Jn Jo, 


4 4g 


a 

>- 

“4 


(4-g)A|f}|^ 


iKr. 


4^59/2 

On the other hand, it can be deduced from (12.91) that for j e {1, 2, • • • , fc}, 

0=(a + 6(|l?Iof+ ^||u*||7))lk7li?-'^ / \yj\^dx 

i=i 

2 ,,, ,,2 d-bS\. ,,4 


>(a + 6 |Kr)lhll 7 - 




‘3 lir>’ 


which implies that 


|kj||x)l,2 > 


52 

52(a + 6|Kf) 

S-bS^ 


Therefore, by (IQ) . we obtain that 

k 

Ib°ivj) =I^{vj) - j{a + b{\\uof + ^\\vi\\l)\\vj\\l, - 6 f \vj\^dx) 


2=1 


/]R4 


_a 2 ^ a5^(a + 6||Mof) 

^\n\\v - ^s-bs^) ■ 


(5.11) 


this, together with (15.111) . yields that 


c= lim Ib{un) > h{uo) +I^{vi) 


a 

4 


l|uo 


(4-g)A 

4g5«/" 


ii«or + 


(aSf 

4(S - bSy 


abS^ 

4(S-bS^) 


IKf 


(aS)^ 1 ' aS 

^4{d-bS)^ ^ V4((5-552) 

^ {aS)^ / ad 

-4{S-bS)^ ^ \4{S-bS‘^) 


(4-g)A|0|V / aqS"^ \ 

4g59/2 V 2S{q-2)J 



2 


here we have used the inequality ||uo|P < l + {aqS^)/{2S{q—2)) since ||rtn|P < l + {aqS^)/(2S{q — 2)) 
and uo is the weak limit of u„ in HgiTt). 

Now, recalling that 2 < g < 4, it follows from one of the assumptions (C1)-(C'3) that 

- 4(5-65)2’ 

this is a contradiction since c < (a5)^/(4(5 — 652)). Therefore, up to a subsequence, {«„} converges 
to some Mo G Hoi^)- Noting that mq 0 (cf. Remak [^?T|) . we know that uq is a desired solution 
ofEq. (HU). I 


Proof of Theorem II.5t 
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(i) We suppose on the contrary that Eq. (ini) has a solution u € -ffg \ {0} under assumptions 
S < bS^ and (11.71) . that is, l'i,{u)v = 0 for all v £ so that 

t{u)u = a\\ur + b\\uf - A||u||^ - <5||u||^ = 0. (5.12) 

For t > 0, we set f{t) = hitu), then 


f{t) = atWuW^ + t^{b\\u\\^ - 5||u||4) - := th{t), 


where h{t) = aHulP +t^(&||u||"‘ — AHwHt) — At'^ ^ll'uH^. It follows from (I5.12|) that /'(I) = 0. On 
the other hand, it is easy to see that 

/ A(g-2)||w||^ 

[2{b\\ur-S\\u\\t)) 

is the unique root of equation h'{t) = 0 on (0,+oo), which, together with the Holder inequality, 
the inequality uni) and the fact of g S (2,4), implies 


min h{t) = h{t) =a\\u\\^ + t (fell'ull'^ — AHuH^) — At'^ ||it||® 


t>o 


=a\\ur-^^^x\\ur 


>a||uf- 


X{q-2)\\u\\l 

‘^\2{b\\ur-d\\u\\t) 

2 . g-2 


q -2 

4-g 


(4-g) / (g-2)5^ Nf^A^ 
2 V2(652-5)J 


II 

U 


.l|.f(«-(4-,)(l)*(^)*(<|^)-).0 


this gives that f'{t) > 0 for all t > 0. Clearly /'(<) > 0 for t > 0 small enough, thus we obtain 
that 0 = /(O) < /(I) = 0, a contradiction. 


(ii) We also use 

To(u) = ^||u|p--||u||«, u£H^{n) (5.13) 

z q 

to denote the limited functional of /{, as 5 —>■ 0+ in the following proof. Clearly, Iq £ C^(iJQ (H), R) 
and critical points of /q are weak solutions of the following equation 

{ —aAu = A|it|‘^“^M, in H, 

M = 0, on cIH. 


Noting that if 0 < d < bS^ then for all u £ Hq(Q,) \ {0} we have 

Mu)=^\\nr + l{b\\ur-S\\u\\i)-^\\u\\l 

>^\Wr + \(.b-^)\\u\\^-^\\u\\l^+oo 

as ||m|| ^ + 00 , therefore is coercive. On the other hand, for given a > 0 and A > 0, we can find 
vq £ i7o(H) \ {0} such that Io{vo) < 0, then there exists 6i > 0 dependent of a and A such that 
for each b £ (0, 6i), Ib{vo) < 0, therefore, d := int{Ib{u) : u £ < 0. By Ekeland variational 

principle, there exists a sequence {un} satisfying Ib{un) —)■ d < 0 and Ib{un) —>■ 0 strongly in 
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It follows from Proposition 12.11 and (12.51) that there exists ui € \ {0} such that 

Un —)> Ml in IJq (f2), thus = 0, so that ui is a solution of (11.11) . To obtain the second solution, 

we just remind that the functional Iq defined by (15.131) has the similar properties (Ml) — (M5), 
then by following the proof of Theorem 11.41 and combining with Proposition 12.II and (12.5|) . we can 
get that there exists 62 > 0 dependent of a and A such that for each b € ( 0 , 62 ), Eq. (11.111 has a 
mountain pass solution ^ 2 ( 7 ^ mi) in both cases of <5 < bS^ and 5 = bS'^, here we omit the details 
of proof. I 

Remark 5.2 Ib satisfies the {PS)c condition for all c G M if the {PS)c sequence is bounded, this 
can be deduced easily from Proposition 12.II and (12.51) . 
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